Generating Instance Segmentation Annotation by Geometry-guided GAN

Instance segmentation is a problem of significance in computer vision. However, preparing annotated data for this task is extremely time-consuming and costly. By combining the advantages of 3D scanning, physical reasoning, and GAN techniques, we introduce a novel pipeline named Geometry-guided GAN (GeoGAN) to obtain large quantities of training samples with minor annotation. Our pipeline is well-suited to most indoor and some outdoor scenarios. To evaluate our performance, we build a new Instance-60K dataset, with various of common objects categories. Extensive experiments show that our pipeline can achieve decent instance segmentation performance given very low human annotation cost.